Avoiding Unintended AI Behaviors

نویسنده

  • Bill Hibbard
چکیده

Artificial intelligence (AI) systems too complex for predefined environment models and actions will need to learn environment models and to choose actions that optimize some criteria. Several authors have described mechanisms by which such complex systems may behave in ways not intended in their designs. This paper describes ways to avoid such unintended behavior. For hypothesized powerful AI systems that may pose a threat to humans, this paper proposes a two-stage agent architecture that avoids some known types of unintended behavior. For the first stage of the architecture this paper shows that the most probable finite stochastic program to model a finite history is finitely computable, and that there is an agent that makes such a computation without any unintended instrumental actions. Hibbard, Bill. 2012. “Avoiding Unintended AI Behaviors.” In Artificial General Intelligence: 5th International Conference, AGI 2012, Oxford, UK, December 8–11, 2012. Proceedings, edited by Joscha Bach, Ben Goertzel, and Matthew Iklé, 107–116. Lecture Notes in Artificial Intelligence 7716. New York: Springer. doi:10.1007/978-3-642-35506-6_12

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Concrete Problems in AI Safety

Rapid progress in machine learning and artificial intelligence (AI) has brought increasing attention to the potential impacts of AI technologies on society. In this paper we discuss one such potential impact: the problem of accidents in machine learning systems, defined as unintended and harmful behavior that may emerge from poor design of real-world AI systems. We present a list of five practi...

متن کامل

Adolescence, Winter 2001 v36 i144 p697(10)

This study examined conflict behaviors (self, other) among 127 Turkish college students. Differences in five conflict behaviors (forcing, avoiding, accommodating, compromising, and collaborating) were then explored in relation to popularity and unpopularity. Results indicated that the students engaged in more avoiding and compromising behaviors, while perceiving more forcing behavior in others....

متن کامل

Factors associated with contraceptive use and nonuse, United States, 2004.

CONTEXT Each year, nearly one in four U.S. women at risk of unintended pregnancy experience one or more months of contraceptive nonuse. Understanding what factors are associated with risky contraceptive use patterns can inform programs and policies designed to reduce levels of unintended pregnancy. METHODS A nationally representative sample of 1,978 adult women at risk for unintended pregnanc...

متن کامل

The association of sociodemographic characteristics and sexual risk behaviors with health literacy toward behaviors for preventing unintended pregnancy among university students

Purpose The aim of this study was to determine whether there is an associated effect between sociodemographic characteristics and sexual risk behaviors with health literacy in preventing unintended pregnancy among university students in Chon Buri province, Thailand. Participants and methods A cross-sectional study design was used. The data were collected between February and May, 2017. A self...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012